Discrete symmetries in the three-Higgs-doublet model 
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TV-Higgs-doublet models (NHDM) are among the most popular examples of electroweak symmetry 
breaking mechanisms beyond the Standard Model. Discrete symmetries imposed on the NHDM 
scalar potential play a pivotal role in shaping the phenomenology of the model, and various symmetry 
groups have been studied so far. However, in spite of all efforts, the classification of finite Higgs- 
family symmetry groups realizable in NHDM for any TV > 2 is still missing. Here, we solve this 
problem for the three-Higgs-doublet model. Using recently found realizable abelian groups and 
applying Burnside's theorem and other group-theoretic tools, we find the full list of finite symmetry 
groups of Higgs-family transformations which are realizable in the scalar sector of 3HDM. 



Introduction. - - The nature of the electroweak sym- 
metry breaking remains one of the hottest issues in high- 
energy physics. It is believed to be mediated by the 
Higgs mechanism, and many different variants of it have 
been proposed so far One conceptually simple and 
phenomenologically attractive class of models involves 
several Higgs doublets with identical quantum numbers. 
The scalar potential in these TV-Higgs-doublet models 
(NHDM) is often assumed to be symmetric under a 
group of unitary (Higgs-family) or anti-unitary (general- 
ized CP) transformations acting in the space of doublets. 
These symmetries play a pivotal role in the phenomenol- 
ogy of the model, both in the scalar and in the fermionic 
sectors, and they often bear interesting astrophysical con- 
sequences. Given the importance of symmetries for the 
NHDM phenomenology, it is natural to ask: which sym- 
metry groups can be implemented in the scalar sector of 
NHDM for a given TV? 

In the two-Higgs-doublet model (2HDM), this question 
has been answered several years ago, 0], see also [3} for a 
review. Focusing on discrete symmetries, the only real- 
izable group of unitary symmetries is Z2 . If anti- unitary 
transformations are included, then (Z2) 2 and (Z2) 3 are 
also realizable. For each group, the corresponding po- 
tential was written and phenomenological consequences 
were studied in detail (for example, an investigation of 
the (Z2) 3 -symmetric 2HDM can be found see [4[). 

With more than two doublets, the problem remains 
open. Variants of NHDM based on several finite groups 
have been studied, with an emphasis on the A4 group, 
[!, 0| , and several attempts have been made to classify 
at least some symmetries in NHDM, In particular, a 
classification of all realizable abelian symmetry groups in 
NHDM for any TV was recently given in [H . However, the 
full list of non-abelian finite groups which can be symme- 
try groups in NHDM scalar sector is not yet known. We 
stress that this task is different from just classifying all 
finite subgroups of SU(3), [§], because invariance of the 
Higgs potential places strong and non-trivial restrictions 
on possible symmetry groups. 

In this paper we solve this problem for the three-Higgs- 
doublet model (3HDM). Starting from abelian groups 
and applying several results from the finite group theory, 
we find the complete list of discrete symmetry groups of 
Higgs-family transformations realizable in 3HDM. Exten- 
sion of our method to groups which include anti-unitary 



transformations will be given elsewhere. 

Structure of finite symmetry groups in 3HDM. — The 
most general renormalizable gauge-invariant scalar po- 
tential of 3HDM can be written as 

V = Y^lh) + ZiMfaiWUi) > (!) 

where all indices run from 1 to 3. We are interested 
in unitary transformations mixing doublets <fn that leave 
this potential invariant for some Yy and Zijki- A priori, 
these transformations belong to the group U(3). Mul- 
tiplying the three doublets by a common phase factor, 
which trivially leaves the potential invariant, is already 
taken into account in the gauge group U(X)y- Therefore, 
we focus on additional transformations not reducible to 
overall phase rotations, which form the group PSU (3) = 
5t/(3)/Z3, where Z3 is the center of SU(3). Our task is 
therefore to find finite subgroups of PSU(3) which can 
be the symmetry groups of the potential |T]) for some 
choices of coefficients. We stress that we search for real- 
izable symmetry groups, that is, for groups G C PSU (3) 
such that there exists a G-symmetric potential which is 
not invariant under a larger symmetry group G' D G, see 
a fuller discussion in [8] . 

Abelian realizable symmetry groups for NHDM were 
characterized in 0. For our task of classifying finite re- 
alizable symmetry groups in 3HDM, the following abelian 
groups must be considered: 

Z 2 , Z 3 , Z 4 , Z 2 x Z 2 , Z 3 x Z 3 . (2) 

The first four are the only realizable finite subgroups of 
maximal tori in PSU(3). The last group, Z3 x Z3, is 
on its own a maximal abelian subgroup of PSU (3), but 
it is not realizable because a Z3 x Z3-symmetric poten- 
tial is automatically symmetric under (Z3 x Z3) x Z 2 , see 
explicit expressions below. However, it still can appear 
as an abelian subgroup of a finite non-abelian realizable 
group, therefore it must be included into consideration. 
Trying to impose any other abelian Higgs-family symme- 
try group on the 3HDM potential unavoidably makes it 
symmetric under a continuous group. 

Let us denote by G c PSU(3) a finite (non-abelian) 
symmetry group in 3HDM. We shall now apply some re- 
sults from the finite group theory to prove that G cannot 
be too large, and more specifically, we shall describe the 
generic structure of G. 
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All abelian subgroups of G must be from the list ((2J. 
By Chauchy's theorem, if p is a prime divisor of the or- 
der of the group, \G\, then G contains a subgroup Z p . 
Thus, the order of the group can have only two prime 
divisors: \G\ — 2 a 3 b . Then according to the Burnside 
p a q ,b -theorem, the group G is solvable. Solvability im- 
plies that G contains a normal abelian subgroup, which 
belongs, of course, to the list (j2J|. This is our first key 
group-theoretic step. 

Suppose A is the normal abelian subgroup of G, A < G. 
Obviously, A C Cq (A), the centralizer of A in G (all 
elements g € G which commute with all a € A). As 
we prove in Appendix, we can assume that A is self- 
centralizing: A — Cg(A). This means that elements 
g G G, g G" A, cannot commute with all elements of A. 
Therefore, they induce automorphisms (i.e. structure- 
preserving permutations) on A: g~ l ag £ A for any 
a € A, and these automorphisms are non-trivial. Even 
more, if g\ and gi induce the same automorphism on A, 
— <?2~ la S2 for all a G A, then g\ and 172 belong 
to the same coset of A in G: g2 = gx a! . Therefore, the 
homomorphism / : G/A — > Aut(A), where Aut(A) is the 
group of automorphisms on A, is injective. We conclude 
that 

G/A = K , K C Aut(A) . (3) 

This is our second key group-theoretic step. It proves 
that G cannot be too large, and it also shows that G can 
be constructed as an extension of A by a subgroup of 
Aut{A): G — A.K. 

We now check all the candidates for A from the list 
([2]) and sec which extension can work in 3HDM. Wc use 
the explicit realization of each of the groups A, and 
search for additional transformations from PSU (3) with 
the desired multiplication properties. 

Extending Z 2 . — If A = Z2, then Aut(Z 2 ) = so 
that G = Z 2 . This case was already considered in [8j. 

Extending Z3. — If A — Z3, then AutiZ^) = 1*%. The 
only non-trivial case to be considered is G/A = Z2, so 
that G is the dihedral group representing the symmetries 
of an equilateral triangle G = Dq = S3. If Z3 group is 
generated by the phase rotations a = diag(cj, cj 2 , 1) with 
u) = 27r/3, then the transformation b generating Z2 and 
satisfying b~ 1 ab = a 2 must be of the form 

/ e lS \ 
b= er lS 0, (4) 
V 0-1/ 

with arbitrary 8. The choice of the mixing pair of dou- 
blets ((/>i and (f>2 in this case) is also arbitrary, so other 6's 
with different pairs of mixing doublets are also allowed. 
The fact that b is not uniquely defined means that there 
is a whole family of Dq groups parametrized by the value 
of 8 even if we start with the fixed group A = Z3. 

The generic Z3-symmetric potential contains the part 
invariant under any phase rotation 

V = - £ ™ 2 M<i>i) + E x iM<t>i){<t>]<t>i) 

+E A «(^^')(^^)> ( 5 ) 



and the following additional terms 

V Z3 = Ai(<^i)((^i) + A 2 (</4<fe)(03>2) 

+A 3 (0 t 1 </> 3 )(4<fe) + h.c. (6) 
with complex Ai, A2, A3. If the parameters of Vq satisfy 
m ii = m 22 1 An = A22 , A13 = A23 , A' 13 = A 23 , (7) 

and if, in addition, moduli of two among the three coef- 
ficients Ai, A2, A3 coincide, for example |Ai| = | A2 1 , then 
the potential Vq + Vz 3 becomes symmetric under one par- 
ticular Dq group constructed with b in ([4| with the value 
of 8 = (arg A2 — arg Ai + 7r)/3. 

This construction allows us to write down an example 
of the Dq potential. In order to prove that Dq is indeed 
a realizable group, we need to show that the resulting 
potential is not symmetric under any other Higgs-family 
transformation. This is proved by the mere observation 
that all other possible groups to be discussed below which 
could contain Dq lead to stronger restrictions on the po- 
tential than and I Ai| = | A2 1 . Therefore, not satisfying 
those stronger restrictions will yield a potential symmet- 
ric only under Dq. Finally, one can also show that the 
potential we obtained does not have any continuous sym- 
metry. The same logic applies to other realizable groups 
below. 

Extending Z4. — If A = Z4 (generated by a), then 
Aut(7h/C) = Z2, so that G = Z4 . Z2. The two non-abelian 
possibilities for G are the dihedral group D% representing 
symmetries of the square, and the quaternion group Q$. 
In both cases b~ 1 ab = a 3 , with the only difference that 
b 2 = 1 for D$ while b 2 = a 2 for Qg. Representing a by 
diag(z, — i, 1), we find 

/ e iS \ / e lS 0\ 

b(D 8 ) = e- lS , b(Q 8 ) = -e- lS 0. 

\ -1 / \ 01/ 

Again, in each case we obtain a family of 6's parametrized 
by phase 8. The Z4-symmetric potential is Vq + Vz^ where 

Vz 4 = A 1 (030 1 )(0 3 2 ) + A 2 (^j> 2 ) 2 + h.c. (8) 

An explicit analysis shows that to make it Dg-invariant, 
we only need to satisfy conditions ([7]). Then, the po- 
tential is symmetric under b(Ds) with the phase 8 = 
arg A2/2. Since any larger group that could possibly con- 
tain Dg leads to stronger restrictions on the potential, we 
conclude that Z3g is realizable in 3HDM. 

Now, if instead of Dg we try to make the potential 
symmetric under Qg, we unavoidably need to set Ai = 
0. Removing one term from {5} immediately makes it 
symmetric under a continuous group of phase rotations, 
[8j. Therefore, Q$ is not realizable in 3HDM. 

Extending Z 2 x Z 2 . — If A = Z 2 x Z 2 , then Aut(Z 2 x 
Z 2 ) = GL2C2) = S3. Z2 x Z2 can be realized as the group 
of independent sign flips of the three doublets with gen- 
erators ai = diag(l, — 1, — 1) and a 2 = diag(— 1, 1, — 1). 
The potential symmetric under this group contains Vq 
and additional terms 

Vz 2X z 2 = Ai 2 (0l02) 2 + W^) 2 + A 3 i(^0i) 2 + h.c. 

(9) 
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The coefficients Ay can be complex; we denote their 
phases as t/>y. 

There are three possibilities to extend A: by Z 2 , by 
Z 3 , and by S3. The first extension, (Z 2 x Z 2 ) .Z 2 , leads 
to Dg,, which was already constructed above. 

The extension by Z3 is necessarily split, (Z 2 x Z 2 ) x Z3, 
leading to the group T ~ A4, the symmetry group of a 
tetrahedron. To construct it, we need to find b acting on 
{ai,a 2 ,aia 2 } by cyclic permutations. Fixing the direc- 
tion of permutations by b^ l a\b = a 2 , we find that b must 
be of the form 






,-i(S 1 +8 2 ) 








j<52 





(10) 



with arbitrary Si, <5 2 . It then follows that if coefficients 
in (0) satisfy 

|A 12 | = |A 23 | = |A 3 i|, (11) 
then Vz 2 xz 2 is symmetric under a particular b with 

2-012 - "031 ~ 023 r 20> 23 - -031 - 12 

6 ' 6 

By rephasing, one can bring ^ to the following form 



V T = A 



?i</>2 



) 2 + 



4<fe) 2 



6 3 0! 



(12) 



with complex A. In addition, the symmetry under b 
places stronger conditions on the parameters of Vq, and 
the most general Vq satisfying them is now 



Vn 



i 



(13) 



A"|0l0,f' 



The last extension, (Z 2 x Z 2 ) . S3, leads to the group O = 
£4, the symmetry group of an octahedron and a cube. It 
includes T as a subgroup, therefore the most general O- 
symmetric potential is Vq from (| 1 3 j) plus Vt from (JTSJ) 
with the additional condition that A is real. 

Extending Z3 x Z3. — Finally, if A = Z3 x Z3, then 
K C Aui(Z 3 x Z3) = GL 2 (3), the general linear group of 
transformations of two-dimensional vector space over the 
finite field F 3 , whose role is played by A. One can define 
an antisymmetric scalar product in this space and prove 
that K must include only transformations from GL 2 (3) 
that preserve this scalar product: K C Sp 2 (3) = SL 2 (3). 

The group SL 2 (3) has order 24 and contains elements 
of order 2,3,4, and 6. Elements of order 6 cannot be used 
for extension because they would generate the abelian 
subgroup Z 6 , which is absent in @. Besides, we will 
show below that K must always contain the subgroup 
Z 2 . There are three kinds of subgroups of K C SL 2 (3) 
containing Z 2 but not containing 7L§: Z 2 , Z4, and 
Since, as we argued, the quaternion group Qs is not re- 
alizable in 3HDM, K can only be Z 2 or Z4. 

To show that Jf 3 Z2, consider first the group P C 
SU(3) generated by 














1 
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- 2 / 












exp 



2ni 
~3~ 



Since [a, b] = aba^b- 1 £ Z(SU(3)), the image of P 
under the canonical homomorphism SU(3) — > PSU(3) 
becomes the desired abelian group Z3 x Z3. The true 
generators of Z 3 x Z 3 are cosets a — aZ(SU(3)) and 
b = bZ(SU{3)) from PSU{3). The Z 3 x Z 3 -invariant 
potential is 



V 



V3 
+A 2 



^01 



(0^2 

i) 2 + 



2^2 



) 2 + 



!»l0 2 | 2 + |02>3| 2 + |0S0l| 



) +A [(0 t 1 1 ) + (0 2 2 ) 

3 ) 2 - (0 t 1 1 )(0|0 2 ) - (0 2 2 )(0 3 3 ) " (0 3 3 )(0 t 1 0l) 

A 3 [(^ t 1 2 )(0 t 1 3 ) + (0 2 3 )(0|0l) + (0 3 0l)(030 2 ) 



h.c. 



(14) 



with real to 2 , Ao, Ai, A 2 and complex A3, all values being 
generic. This potential is, however, symmetric under a 
larger group (Z 3 x Z3) x Z 2 , which is generated by a, b, c 
with the following relations 

a 3 = b 3 = 1, c 2 = 1, [a, b] = 1, cacT 1 = a 2 , cbc' 1 = b 2 . 

In terms of the explicit transformation laws, c is the coset 
cZ(SU(3)), with c being the exchange of any two dou- 
blets, so that (a, c) = S3 is the group of arbitrary permu- 
tations of the three doublets. Thus, if G = (Z 3 x Z 3 ) . K, 
then a G-symmetric potential must be a restriction of 
dHJ), so that K D Z 2 . 



Turning now to the extension G = (Z3 x Z3) x Z4, we 
note that SL 2 (3) contains three distinct Z4 subgroups, 
which however intersect at the center of SL 2 (3). All three 
are conjugate inside SL 2 (3) and lead, up to isomorphism, 
to the same symmetry group. To give an example of a 
potential symmetric under (Z3 x Z3) x Z4, we choose 
an element d £ SL 2 (3) of order 4 that generates the 
cyclic permutation of generators a, 6, a 2 ,6 2 . It can be 
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represented by the following SU(3) transformation: 

./ll 1 \ 

d = — l u 2 lj , d~ l = d* , d 4 = 1 . (15) 
^ 3 V 1 u oj 2 J 

Then by analyzing how the potential changes under d, we 
obtain the following criterion: (1141) becomes symmetric 
under (Z 3 x Z 3 ) x Z 4 , if A 3 is real and is equal to (V3X\ — 
\%)/2. One can also show that the resulting potential is 
not invariant under any continuous symmetry group. 

Summary. — Because of important phcnomcnological 
role the symmetries play in multi-Higgs-doublet models, 
the task of classifying all symmetries in NHDM is of much 
interest. Here we solved this problem for 3HDM. Focus- 
ing on groups of unitary transformations and including 
the finite abelian groups found in Q, we obtain the fol- 
lowing list of finite groups realizable as Higgs- family sym- 
metry groups of the 3HDM scalar sector: 

Z 2 , Z 3 , Z 4 , Z 2 x Z 2 , 

D 6 , D s , T~A 4 , 0~S 4 , 

(Z 3 x Z 3 ) x Z 2 , (Z 3 x Z 3 ) x Z 4 . (16) 

This list is complete: trying to impose any other finite 
Higgs-family symmetry group on the 3HDM potential 
will unavoidably lead to a potential symmetric under a 
continuous group. 

Applying methods described in Q , one can also obtain 
the list of realizable groups in 3HDM which include anti- 
unitary transformations. These results as well as a study 
of symmetry breaking patterns for each of these groups 
will be presented elsewhere. 
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EXISTENCE OF NORMAL ABELIAN 
SELF-CENTRALIZING SUBGROUPS 

In the main text we stated that the normal abelian 
subgroup A C G, whose existence follows from the 
Burnside's theorem, can be taken self-centralizing: A = 
Cg{A). Here we prove this statement: namely, we show 
that even if A C Cg (A) , then there exists another abelian 
subgroup A' D A, which is normal and self-centralizing 
in G. 

Suppose that A C C G {A). Then for every b e C G {A) 
the group Ab — (A, b) is an abelian subgroup of G, which 
properly contains A. There are three possibilities com- 
patible with the list (i) A = Z2, and there exists 
b € Cq{A) such that At, = Z4, (ii) A = Z 2 , Ab is neces- 
sarily Z 2 x Z 2 and every non-trivial element from Cg(A) 
has order 2, (iii) A = Z 3 , then At = Z 3 x Z 3 and every 
non-trivial element of Cg(A) has order 3. 

In case (i) we have either Cq{A) = Z4 (then it is self- 
centralizing and normal in G and plays the role of the 
desired group A'), or Cg{A) D Z4, which automatically 
leads to a continuous symmetry in 3HDM and is, there- 
fore, disregarded (we either get an abelian group absent 
from the list ([2]) or the quaternion group Q%, both pos- 
sibilities leading to a continuous symmetry). 

In case (ii) Cg{A) is abelian (a group in which every 
nonzero element has order 2 is abelian) and is also normal 
in G (centralizer of a normal subgroup A is always normal 
as it is the kernel of the homomorphism G — > Aut(A)). 
Therefore, Ab — Cg(A) is the desired normal abelian 
self-centralizing subgroup A'. 

In case (iii) we note that every G-invariant poten- 
tial is also A^A^-invariant. Nc{Ab)/Ab cannot have 
elements of order 3 (see the arguments in Extending 
Z 3 x Z 3 ). Then, At is a Sylow 3-subgroup of NciAb). 
On the other hand, Ab C Cg{A) and Cg(A) is a 3- 
group, and so is its subgroup Nc G (A){^b)- Therefore, 
Nc G (A)(Ab)/Ab cannot have elements of order 3 and, 
simultaneously, must be a 3-group. This means that 
Nc G (A)(Ab) = Ab. Finally, since every proper subgroup 
of a p-group is propertly contained in its normalizer, we 
conclude that Ab = Cg{A) — CoiAb), and therefore, it 
is normal in G. 



